METHOD, APPARATUS AND RECORDING MEDIUM FOR IMAGE PROCESSING 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image processing 

method and an image processing apparatus for changing a 
color and a tone in a specific area included in a color image. 
The present invention also relates to a computer - readable 
recording medium storing a program to cause a computer to 
10 execute the image processing method. 

Description of the Related Art 
Reproduction of digital image data obtained by digital 
still cameras (hereinafter referred to as a digital camera) 
and digital image data obtained by reading images recorded 
15 on film has been carried out to generate hard copies such 

as prints, or soft copies on display screens. In such 
reproduction of digital image data, a reproduced image is 
expected to have as high a quality as a photograph printed 
from a film negative. 
20 Color reproducibility of the same person's face can 

vary between prints. Furthermore, in an image including a 
plurality of people, color reproducibility of each person ' s 
face can be different, depending on the intensity or 
position of a light source. In the case of an image 
25 including a person obtained by photographing, the face of 

the person attracts the most attention. In order to 



1 



generate a high-quality photograph, correction of the face 
so as to have an adequate skin color is necessary. To 
accomplish this, various methods of changing a skin color 
of an image to a preferable skin color, for example by using 
5 a display means such as a monitor and a mouse have been 

developed. One such method comprises the steps of using a 
mouse to extract pixels of skin color from an image including 
a person's face and changing the skin color value to a color 
and tone of a predefined preferable skin color value using 

10 the extracted color value as reference (Japanese Patent No. 

2878855, for example) . A second proposed method comprises 
the steps of specifying an area of color to be changed 
contained within a displayed image, specifying the color 
nearest to the most preferable color for the area in which 

15 the change is desired, upon which the color of the area is 

= changed to a pre-defined color (Japanese Unexamined Patent 

Publication No. 8 ( 19 96 ) - 22 1546 ) . Furthermore, in a third 
proposed method, the areas containing human faces are 
automatically extracted and the color of the areas 

20 containing faces is changed to a predefined color. 

However, in all the methods described above, because 
the skin color of a human face is changed to a predetermined 
skin color, the human face does not necessarily have a 
preferable skin color af ter the change . Furthermore, since 

25 only the face color is changed, a sharp - contrast face of 

a person in an image obtained by photographing outdoors in 



sunny weather cannot be corrected. 

SUMMARY OF THE INVENTION 
The present invention has been conceived in 
consideration of the above described problems. An object 
of the present invention is therefore to provide an image 
processing method and an image processing apparatus which 
can change a specific area in an image such as a human face 
to a preferable color and tone (hereinafter, the color and 
tone are together referred to as the color-tone), and to 
provide a computer - readable recording medium storing a 
program to cause a computer to execute the image processing 
method . 

An image processing method of the present invention 
comprises the steps of: 

receiving specification of a first area having a 
desired color- tone in a displayed image; 

receiving specification of a second area in the image 
or in another image; and 

changing a color-tone of a desired area including the 
second area into the color- tone of the first area. 

In the step of receiving the specification of the first 
area, not only one area but also a plurality of areas may 
be specified. 

The "desired area including the second area" can refer 
to not only the entire second area, but also a specific area 
in the second area, the entire image including the second 



area, as well as areas comprising the second area and another 
area . 

Furthermore, the specification of the first area may 
precede the specification of the second area, or vice versa. 

Any object can be specified as a first or second area, 
for example, a human face, the sky, or green foliage. 

An image processing apparatus of the present invention 
compr i ses : 

display means for image display; 

area specification means for specifying a first area 
having a desired color-tone in an image displayed on the 
display means and a second area in the image or in another 
image; and 

conversion means for converting a color-tone of a 
desired area including the second area into the color-tone 
of the first area. 

The image processing method of the present invention 
may be provided as a program stored in a computer - readabl e 
recording medium to cause a computer to execute the image 
processing method. 

According to the present invention, a first area 
having the desired color-tone in the displayed image is 
specified, and a second area in the image including the first 
area or in another image is specified. The color-tone of 
the desired area including the second area is converted into 
the color- tone of the firs t area . Thereby, the desired area 



including the second area can be changed to have the 
color-tone desired by a user. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a block diagram showing a configuration 

of an image processing apparatus according to an embodiment 

of the present invention; 

Figure 2 shows an image displayed on a monitors- 
Figure 3 shows the image in which an area Rl has been 

specified; 

Figure 4 is a diagram showing a skin-color range in 
a CIELAB color space; 

Figure 5 is the image in which an area R2 has been 
specified ; 

Figure 6 shows cumulative histograms; 

Figure 7 is a flow chart showing operation of the 
embodiment; and 

Figure 8 shows an image in which a plurality of faces 
have been specified as area Rl . 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Hereinafter, an embodiment of the present invention 
will be explained with reference to the accompanying 
drawings . 

Figure 1 is a block diagram showing a configuration 
of an image processing apparatus according to the first 
embodiment of the present invention. As shown in Figure 1, 
the image processing apparatus obtains processed image data 



SI by carrying out image processing on image data S obtained 
by photographing using a digital camera, reading an image 
with a scanner, or another means. The image processing 
apparatus comprises reading means 1 for reading the image 
data S from a recording medium or for reading the image data 
S transferred via a network, image processing means 2 for 
carrying out the image processing on the image data S, a 
monitor 3 for displaying the image data S, and input means 
4 comprising a keyboard and a mouse for carrying out various 
inputs to the image processing means 2 . In this embodiment, 
the case of changing a color- tone of a human face in an image 
is explained. 

The image processing means 2 carries out the image 
processing on the image data S in the following manner. 
First, the image data S is displayed on the monitor 3. 
Figure 2 shows the image displayed on the monitor 3. As 
shown in Figure 2, the image including people's faces is 
displayed on the monitor 3. A user observes the image 
displayed on the monitor 3 and specifies the image of a face 
having the most preferable color-tone by using the input 
means 4. More specifically, the user specifies the image 
of a face having a desired color-tone by surrounding the 
image of the face with a rectangle by using the mouse of 
the input means 4. Figure 3 shows a state in which the image 
of a face having a desired color-tone has been specified. 
As shown in Figure 3, the image of a face having a desired 



color- tone is specified by a rectangular area Rl . 

After the area Rl has been specified in the above manner, 
the image processing means 2 extracts from the area Rl an 
area Rl ' containing pixels within a predefined skin-color 
5 range. For this extraction, a skin-color range D circled 
in a CIELAB color space shown in Figure 4 is predefined and 
pixel values of the image contained in the area Rl are 
converted into the CIELAB color space. Pixels having pixel 
values within the skin-color range D are then extracted as 
,10 the skin-color area Rl ' . 

The user specifies, as an area R2 , an area including 
an image of a face whose color-tone is to be changed to the 
color- tone of the image of the face in the area Rl . This 
specification is carried out in the same manner as in the 
15 specification of the rectangular area Rl . Figure 5 shows 

a state in which the area R2 has been specified in addition 
to the area Rl . After the area R2 has been specified in the 
above manner, a skin-color area R2 ' in the area R2 is 
extracted as in the case of the area Rl ' . 
20 After the skin-color areas Rl ' and R2 ' have been 

extracted, cumulative histograms of the skin-color areas 
Rl ' and R2 ' are generated. Figure 6 shows cumulative 
histograms HI and H2 of the skin-color areas Rl' and R2 ' , 
respectively. In Figure 6, the farther the horizontal axes 
25 in the cumulative histograms HI and H2 go toward the left 
and toward the right from the origin, the larger RGB 



densities become. For cases in which the image data S 
comprises data of RGB colors, the cumulative histograms HI 
and H2 are generated for each color. For simplicity, one 
set of RGB data comprising the data of RGB colors are assumed 
5 and the cumulative histograms HI and H2 are generated from 

the RGB data. The cumulative histograms Hi and H2 represent 
characteristics of the color-tone in the skin-color areas 
Rl ' and R2 ' , respectively. Hereinafter, these 

characteristics are referred to as characteristic 

10 quantities. 

After the cumulative histograms HI and H2 are 
generated in the above manner, color-tone conversion 
processing to cause the color-tone of the skin-color area 
R2 ' to become the color-tone of the skin-color area Rl ' is 

15 carried out based on the cumulative histograms HI and H2 . 

This color-tone conversion processing is carried out by 
relating the cumulative histogram HI with the cumulative 
histogram H2 as shown by dashed lines in Figure 6 and by 
changing the color-tone of the skin-color area R2 ' so as 

20 to cause a pixel value whose RGB density is PI in the 

cumulative histogram H2 to have an RGB density P2 . Let a 
function representing the cumulative histogram HI be g(d') 
and let a function representing the cumulative histogram 
H2 be f(d). The processing shown by the dashed lines in 

25 Figure 6 can be expressed by Equation (1) below: 

d' = g-Mf (d) ) (1) 



If only the color-tone of the skin-color area R2 ' is 
changed, a boundary thereof looks unnatural . Therefore, it 
is preferable for the color-tone to be changed gradually 
at the boundary. 
5 Operation of the first embodiment will be explained 

next. Figure 7 is a flow chart showing the operation of this 
embodiment. The image data S are read and input to the image 
processing means 2 (Step SI) . The image data S input to the 
image processing means 2 are displayed on the monitor 3 (Step 

10 S2) . The user observes the image displayed on the monitor 

3 and specifies the area Rl including the image of a face 
having the desired color- tone. The user inputs completion 
of the specification by using the input means 4 (Step S3) . 
After the completion of the area Rl , the skin-color area 

15 Rl ' included in the area Rl is extracted (Step S4) . 

Meanwhile, the user specifies the area R2 including 
the image of a face whose color- tone is to be changed to 
become the same as the color- tone of the area Rl while viewing 
the image displayed on the monitor 3, and completes input 

20 of specification of the area R2 from the input means 4 (Step 

S5) . After completion of the specification of the area R2 , 
the skin-color area R2 ' included in the area R2 is extracted 
(step S6) . 

After the extraction of the skin-color areas Rl ' and 
25 R2 ' , the cumulative histograms HI and H2 of the skin-color 

areas Rl ' and R2 ' are generated (Step S7) . Based on the 
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cumulative histograms HI and H2 , the color- tone of the 
skin-color area R2 ' is changed to become the color- tone of 
the skin-color area Rl ' according to Equation (1) , and the 
processed image data SI are obtained (Step S8) to end the 
5 procedure. 

As has been described above, in this embodiment, the 
area Rl having the desired color- tone is specified and the 
color-tone of the area R2 is changed to become the color-tone 
of the face image in the area Rl . Therefore, the skin-color 

10 area R2 ' in the area R2 can be changed to have the color- tone 
desired by the user. 

In the above embodiment, the color- tone of only the 
skin-color area R2 ' in the area R2 is changed. However, a 
color-tone of the entire area R2 may be changed. 

15 Alternatively, a color-tone of a predetermined area 

including the area R2 or the entire image displayed on the 
monitor 3 (excluding the area Rl) may be changed. 

In the above embodiment, the area R2 is specified in 
the image in which the area Rl has been specified. However, 

20 the area R2 may be specified in an image different from the 

image having the area Rl . 

Furthermore, in the above embodiment the image of a 
face having a desired color-tone is specified as the area 
Rl . However, for cases in which there are a plurality of 

25 images of faces having a desired color- tone, the area Rl 

may be specified so as to include the all of said images 



of faces. For example, in the image having people's faces 
as shown in Figure 2, if face images of three people from 
the left have a desired color-tone, the area Rl is specified 
so as to include the face images of the three people, as 
5 shown in Figure 8. Therefore, an image of a face whose 

color-tone is to be changed to the color-tone of the face 
images in the area Rl is the face image on the right, and 
this face image is specified by the area R2 . In this case, 
as in the above embodiment, a skin-color area Rl ' 

10 corresponding to the images of the faces of the three people 

in the area Rl is extracted and a cumulative histogram HI 
is generated for the skin-color area Rl ' that has been 
extracted. Based on the cumulative histogram HI and a 
cumulative histogram H2 of a skin-color area R2 ' in the area 

15 R2 including the image of the face on the right, the 

color- tone of the skin-color area R2 ' is changed as in the 
embodiment described above. 

In the above embodiment, the first and second areas 
Rl and R2 are specified as the rectangular areas. However, 

20 the areas may be specified as areas having any shape. 

In the above embodiment, characteristic quantities of 
the color- tone of the skin-color areas Rl ' and R2 ' in the 
areas Rl and R2 are represented by the cumulative histograms 
HI and H2 , which is not necessarily limited to these 

25 histograms. 

In the above embodiment, the color- tone of the image 



of a face is changed. However, an area Rl having a desired 
color- tone of the sky, green foliage or the like may be 
specified in an image so that a color-tone of another area 
R2 is changed to have the same color- tone of the area Rl . 
5 In addition, all of the contents of Japanese Patent 

Application Nos. 1 1 ( 1 9 99 ) - 3 6 9 3 3 8 and 2000 -329034 are 
incorporated into this specification by reference. 
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